Maximum information stratification method for controlling item exposure in computerized adaptive testing.
نویسندگان
چکیده
The proposal for increasing the security in Computerized Adaptive Tests that has received most attention in recent years is the a-stratified method (AS - Chang and Ying, 1999): at the beginning of the test only items with low discrimination parameters ( a ) can be administered, with the values of the a parameters increasing as the test goes on. With this method, distribution of the exposure rates of the items is less skewed, while efficiency is maintained in trait-level estimation. The pseudo-guessing parameter ( c ), present in the three-parameter logistic model, is considered irrelevant, and is not used in the AS method. The Maximum Information Stratified (MIS) model incorporates the c parameter in the stratification of the bank and in the item-selection rule, improving accuracy by comparison with the AS, for item banks with a and b parameters correlated and uncorrelated. For both kinds of banks, the blocking b methods (Chang, Qian and Ying, 2001) improve the security of the item bank.
منابع مشابه
A Strategy for Controlling Item Exposure in Multidimensional Computerized Adaptive Testing
While computerized adaptive tests have enjoyed tremendous growth in the past decade, satisfactory solutions for many important problems are still unavailable. Among these problems, a critical one is the control of item exposure rate. Because adaptive algorithms are designed to select optimal items, they tend to choose items with high discriminating power. Thus, these items are selected far more...
متن کاملA Gradual Maximum Information Ratio Approach to Item Selection in Computerized Adaptive Testing
For long-term quality control of computerized adaptive test (CAT) programs, optimizing the usage of the item bank (i.e., controlling item exposure rate) is critical. Selecting the best item often conflicts with the procedure for item exposure control, however. In this study, a newly proposed approach to item selection in CAT, in which the efficiency of items is considered in the early stages of...
متن کاملComparison of methods for controlling maximum exposure rates in computerized adaptive testing.
This paper has two objectives: (a) to provide a clear description of three methods for controlling the maximum exposure rate in computerized adaptive testing -the Symson-Hetter method, the restricted method, and the item-eligibility method- showing how all three can be interpreted as methods for constructing the variable sub-bank of items from which each examinee receives the items in his or he...
متن کاملNon–Fisher-Information Item Selection Criteria 1 Running head: Non–Fisher-Information Item Selection Criteria Comparison of Non–Fisher-Information Item Selection Criteria in Fixed-Length Computerized Adaptive Testing
The maximized Fisher information (MFI) criterion has been the mainstream of the item selection algorithm in many computerized adaptive test (CAT) programs because of its effectiveness and simplicity. There are still several issues with the MFI criterion, however, that need to be resolved in the field, specifically regarding estimation accuracy at the beginning of CAT administration and item poo...
متن کاملContent Balancing in Stratified Computerized Adaptive Testing Designs
For computerized adaptive testing (CAT) programs that adopt three-parameter logistic model, high discriminative items generally provide more information for trait estimation. The information based item selection methods in administering computerized adaptive tests (CATs) tend to choose the item that provides maximum information at an examinee’s estimated trait level. As a result, these methods ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Psicothema
دوره 18 1 شماره
صفحات -
تاریخ انتشار 2006